Varieties of learning in Soar : 1987
نویسندگان
چکیده
Soar is an architecture for intelligence that integrates learning into all of its problem-solving behavior. The learning mechanism, chunking, has been studied experimentally in a broad range of tasks and situations. This paper summarizes the research on chunking in Soar, covering the effects of chunking in different tasks, task-independent applications of chunking and our theoretical analyses of effects and limits of chunking. We discuss what and when Soar has been able to learn so far. The results demonstrate that the variety of learning in Soar arises from variety in problem solving, rather than from variety in architectural mechanisms.
منابع مشابه
Knowledge Level Learning in Soar
In this article we demonstrate how knowledge level learning can be performed within the Soar architecture. That is, we demonstrate how Soar can acquire new knowledge that is not deductively implied by its existing knowledge. This demonstration employs Soar's chunking mechanism — a mechanism which acquires new productions from goalbased experience — as its only learning mechanism. Chunking has p...
متن کاملCYPRESS-Soar: A Case Study in Search and Learning in Algorithm Design
This paper describes a partial reimplementation of Doug Smith's CYPRESS algorithm design system within the Soar problem-solving architecture. The system, CYPRESS-SOAR, reproduces most of CYPRESS' behavior in the synthesis of three divide-and-conquer sorting algorithms from formal specifications. CYPRESS-Soar is based on heuristic search of problem spaces, and uses search to compensate for missi...
متن کاملLearning General Search Control from Outside Guidance
The system presented here shows how Soar, an architecture for general problem solving and learning, can acquire general search-control knowledge from outside guidance. The guidance can be either direct advice about what the system should do, or a problem that illustrates a relevant idea. The system makes use of the guidance by first formulating an appropriate goal for itself. In the process of ...
متن کاملRepresentation Transfer via Elaboration
Introduction A key component of any reinforcement learning (RL) algorithm is the underlying representation used by the agent for learning (e.g. the parameterization of its function approximator). Transfer learning tasks typically look at speeding up a target task after learning in a source task. This paper considers a different, but related, question: is it possible, and desirable, for agents t...
متن کاملCognitive Robotics Using the Soar Cognitive Architecture
Our long-term goal is to develop autonomous robotic systems that have the cognitive abilities of humans, including communication, coordination, adapting to novel situations, and learning through experience. Our approach rests on the integration of the Soar cognitive architecture with both virtual and physical robotic systems. Soar has been used to develop a wide variety of knowledge-rich agents...
متن کامل